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Abstract — It was recently conjectured that a vector with 
components equal to the Bethe permanent of certain submatrices 
of a parity-check matrix is a pseudocodeword. In this paper 
we prove a stronger version of this conjecture and investigate 
the families of pseudocodewords obtained by using the Bethe 
permanent in two particular cases. We also highlight some 
interesting properties of the permanent of block matrices and 
their effects on pseudocodewords. 

Index Terms — Bethe permanents, permanents, low-density 
parity-check codes, pseudocodewords. 

I. Introduction 

IN HI, a simple technique is presented for upper bounding 
the minimum Hamming distance of a binary linear code 
that is described by an m x n parity-check matrix H, based 
on explicitly constructing codewords with components equal 
to F 2 -determinants of some m x m submatrices of H. Subse- 
quently, this technique was extended and refined in [2|-j4) in 
the case of quasi-cyclic binary linear codes and by computing 
those determinant components over the ring of integers Z 
instead of over the binary field ¥2 (and taking their absolute- 
value) and showing that the resulting integer vectors are 
pseudocodewords, i.e., vectors that lie in the fundamental cone 
of the parity-check matrix of the code J5), J6j. In addition, in 
flU, a closely related class of pseudocodewords called perm- 
pseudocodewords was defined, obtained by taking the vector 
components to be equal to the Z-permanent of some m x m 
submatrices of H instead of the determinant. 

Related to this last construction, Vontobel introduced in j7] 
Sec. IX] a similar vector but having components equal to the 
Bethe permanent of some m x m submatrices of a matrix 
H instead of the regular permanent, and conjectured that this 
vector is a pseudocodeword. The Bethe permanent was a term 
introduced in (7) to denote the approximation of a permanent 
of a non-negative matrix, i.e., of a matrix containing only non- 
negative real entries, by solving a certain Bethe free energy 
minimization problem. Vontobel also provided some reasons 
why the approximation works well, by showing that the Bethe 
free energy is a convex function and that the sum-product 
algorithm finds its minimum efficiently. 

In this paper we state and prove a stronger version of 
the above mentioned conjecture and discuss some interesting 
properties of Bethe permanents and their relationships to 
pseudocodewords . 

The remainder of the paper is structured as follows. In 
Section [TT] we list basic notations and definitions, provide the 
necessary background, and formally define the class of perm- 
pseudocodewords and Bethe perm-vectors. In Section [Til] we 
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give the main steps for proving the conjecture, and in Section 
ITVl we compute exactly the Bethe perm-pseudocodewords in 
two cases and offer some remarks and examples. We conclude 
the paper in Section [V] In the Appendix we included a proof 
of an important lemma used to prove the conjecture and three 
lemmas used in Section [TV] 

The literature on permanents and adjacent areas of counting 
perfect matchings, counting 0-1 matrices with specified row 
and column sums, etc., is vast. Most relevant to this paper are 
the very recent work |[8| that studies the so-called fractional 
free energy functionals and resulting lower and upper bounds 
on the permanent of a non-negative matrix, the paper [9| on 
counting matchings in graphs with the help of the sum-product 
algorithm, and the papers on max-product/min-sum algorithms 
based approaches to the maximum weight perfect matching 
problem ifTOl— lfT3l. 



II. Definitions and Background 

Let Z, M, and F2 be the ring of integers, the field of real 
numbers, and the finite field of size 2, respectively. Rows and 
columns of matrices and entries of vectors will be indexed 
starting at 1. If H is some matrix and if a = {ix, . . . , i r } and 
/3 = {ji, . . . , j s } are subsets of the row and column index sets, 
respectively, then H a ,/3 is the sub-matrix of H that contains 
only the rows of H whose index appears in the set a and 
only the columns of H whose index appears in the set (3. If 
a is the set of all row indices of H, we will simply write Hg 
instead of H Q ( g. Moreover, for any set of indices 7, we will 
use the short-hand j\i for 7\ {«}. For an integer M, we will 
use the common notation [M] = {1, . . . , M}. For a set a, \a\ 
will denote the cardinality of a (the number of elements in 
the set a). The set of all M x M permutation matrices will 
be denoted by Vm- 



Definition 1. Let 6 



be an m x m-matrix over some 



commutative ring. Its determinant and permanent, respectively, 
are defined to be 

det(0) = ^2 sgn(er) ijO . (i) , 
perm(6») = ^ IT ' 



where the summation is over all ml permutations of the set 
[m], and where sgn(cr) is the signature operator. □ 

In this paper, we consider only permanents over the integers. 

Definition 2. Let H = (hij) be an mxn parity-check matrix 
of some binary linear code. The fundamental cone JC(U) of 



2 



H is the set of all vectors uj 



G WL n that satisfy 



LJj 



j'Gsupp(Ri)\j" 



for all j G [n] , (1) 
uiji for all i G [m] ant/ j G supp(Ri) , 



(2) 



where R^ ;s //ze i-/7z row vector of H ant/ supp(R;) is 
its support (the positions where the vector is non-zero). A 
vector uj G A^(H) is called a pseudocodeword l[T4\l). Two 
pseudo-codewords uj,uj' € ?C(H) are sa/a" fo fee in ?/ze same 
equivalence class if there exists an a > smc/i f/;af a; = a-uj'. 
In this case, we write uj oc uj' . □ 

There are two ways of characterizing pseudocodewords in 
a code C: as codewords in codes associated to covers of the 
Tanner graph corresponding to C, or using the computationally 
easier linear programming (LP) approach, which connects 
the presence of pseudocodewords in message passing iterative 
decoding and LP decoding [14|, |15|. Here we take the latter 
approach. 

Definition 3. Let C be a binary linear code described by a 
parity-check matrix H G F™ xn , m < n. For a size-(m+l) 
subset ft of [n] we define the perm-vector based on f3 to be 
the vector ugZ" with components 

A J P erm z( H /3v) tfi e P 

10 otherwise . □ 

In ||4) it was shown that these vectors are in fact pseu- 
docodewords. We state this here for easy reference together 
with its proof. 

Theorem 4. (from Let C be a binary linear code described 
by the parity-check matrix H G F™ xn , m < n, and let /? be 
a size-(m+l) subset of [n]. The perm-vector uj based on (3 is 
a pseudocodeword of H. 

Proof: We need to verify (Q]) and (0. From Definition [3] 
it is clear that uj satisfies (Q~|i. To show that uj satisfies 0, we 
fix an i G [m] and a j £ supp(Ri). If j : ^ (3 then u)j = 
and (O is clearly satisfied. If j G /3, then 



E 



/ 4 ~ w 3 
j'Gsupp(R;)\j j'esupp(Ri)\j 



hij/tiJji 



hij> ■ perm (H^v) + 2J ^j' ' 

j'e(N\/3)\i 

= ^ hij> hi <i" P erm ( H H\i,/3\{j'.i"}) 
j'ePXi j"€P\j' 



(*) 



i'6/3\j 



MV,/3\{/,i} 



= /lij ^ /lij, perm (H [m] \ i)/3 \ {i / ii} ) 
= hij perm (H^-) = hijuj^ Wj , 



where at step (*) we kept only the terms for which j" = j, 
and where step (**) follows from j G supp(Ri). Because 
i G [m] and j G supp(Ri) were taken arbitrary, it follows 
that uj satisfies ■ 



Example 5. Consider the [4,2,2] binary linear code C based 

on the parity-check matrix H = ^ | | ^ , where n — 4 

and m = 2. The following list contains the perm-vectors based 
on all possible subsets f3 C [4] of size m+1 = 3: (2, 1, 1,0), 
(1, 1, 0, 1), (1, 0, 1, 1), (0, 1, 1, 2). It can be easily checked that 
these satisfy the inequalities of the fundamental cone above, 
as the theorem predicts. □ 

The following combinatorial description of the Bethe per- 
manent can be found in Q. We use it here as a definition. 

Definition 6. Let 8 be a non-negative ( with non-negative real 
entries) mxm matrix and M be a positive integer. Let ^ m ,n.M 
be the set 



A T)m X n 



m,n.M ' M 



{P = (P ij ) i€[m] | P Z] EV M }. 



If m = n, we will use ^ m ,M = ^m,n,M- 

For a matrix P G ^ m ,M, the P-lifting of 9 is defined as 
the mM x mM matrix 

(#11-Pll ■ • ■ &lmPlm 
: : 
@m 1 Pm 1 ■ ■ • $mm Pmm / 

and the degree-M Bethe permanent of 6 is defined as 



perm B)M (0) 4 ^(perm^ 1 *))^^, 

where the angular brackets represent the arithmetic average 
o/perm(6^ p ) over all P G ^ m ,M- 

Then, the Bethe permanent of 9 is defined as 

perm B (9) = lim sup perm B M {9). □ 

M— s-oo 

Remark 7. Note that a P-lifting of a matrix 9 corresponds to 
an Af-cover graph of the protograph described by 9, therefore 
we can consider 9^ p to represent a protograph-based LDPC 
code and 9 to be its protomatrix (T6l . □ 

Definition 8. Let C be a binary linear code described by a 
parity-check matrix H G F™ xn , m < n. For a size-(m+l) 
subset j3 of [n] we define the Bethe perm-vector based on (3 
to be the vector ujb G K" with components 

a j perm B (H^) if i G £ 

W B i — < 

I otherwise . 

Similarly, we define degree-M Bethe perm-vector based on 
j3 to be the vector ujb.m G Q" with components 



^ fperm B M (H^) if i G 
1° 



otherwise 



□ 



The following conjecture is stated in JT). 

Conjecture 9 ( Q). Let C be a binary linear code described 
by an m x n binary parity-check matrix H, with m < n, 
and let /3 be a size-(m + 1) subset of [n\. Then the Bethe 
perm-vector a; B based on /3 is a pseudocodeword ofH, i.e., 

w B e/C(H). 

We will in fact prove the following stronger form of the 
conjecture. 
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Theorem 10. Let C be a binary linear code described by an 
mxn binary parity-check matrix H, with m < n, and let j3 be 
a size-(m + 1) subset of [n]. Then, for all M 1, the degree- 
M Bethe perm-vectors Wb,m and the Bethe perm-vector u>b 
based on f3 are pseudocodewords of H, i.e., l^b.m € ^(H) 
and u>b € /C(H). 

We will call these pseudocodewords the degree-M Bethe 
perm-pseudocodeword based on j3 and the Bethe perm- 
pseudocodeword based on f3, respectively, and, when we are 
considering both sets, we will call them the Bethe pseudocode- 
words. 

In proving Theorem 1 1 01 it is enough to show that ujb.m G 
/C(H), for all M > 1. Then, by taking the limit it follows that 
wb G /C(H), as the next lemma shows. 

Lemma 11. Let C and (3 as in Theorem\TU\ Ifu>B,M € /C(H), 
for all M ^ 1 integers, then ujb G /C(H). 

Proof: Since u>b,m € /C(H), for all M ^ 1, each of 
the inequalities in (Q~|) and (O is satisfied by u>b, M,i, i G 
Taking the limit when M — >■ oo gives that u>B,i must also 
satisfy the same inequalities. It follows that ljb G /C(H). ■ 

III. Proof of Theorem [Tol 

Before proving this theorem, we need a few lemmas and 
theorems. 

Let 9 = l mX m be the all-one matrix of size m x m. Let I 
denote the identity matrix of size M x M and for all m ^ 1, 
let 



Pm-l,m,M 



perm 

Qe*m-l,m,M 



Qn Q12 



Ql.m 



Qm-l,7n,M 



Pm,M 



Qrn—1 , 1 Qm — 1,2 ' ' ' Qm—1, 
A Pm—l,m,M Pm — l,m : M 

~ ( M |)(m-l)m " |^ m _ ljmiM |' 



perm 

Pe* m _i,jv/ 



Pl,m~l 



Qm.M 



I Pm —1,1 ' An — 1 , m — 1 



and 



(M!)(™-D 2 |* m , M |' 
Lemma 12. We /jave f/ze following relations between q m .M, 
q m ~i, m ,M, and the average ( perm(6> tR )) RgiPm 

Qm,M = q m -l,m,M = (P erm (^ tR )) Re * m M 

Proof: Any R-lifting of the matrix 9, R = G 
M> can be written as 



0tR = 



-^21 ^22 



Rrnl Rm2 ' ' ' -R?? 



Because the permanents are not affected by row or column 
permutations, we can apply permutations of columns to reduce 
the lifting matrix to the simpler form 



R21R11 R22R12 

Rm lRjl Rm2 R\2 
I I 

Qn Q12 



1 

R2mRj n 

RmmRlrt 
I 

Q 1 771 



Q 



m — l.m 



(3) 



Qm-1,1 Qm— 1,2 
followed by row permutations to reduce it to 
[I I ■■■ I 

I QjiQl2 ■ ■ ■ QjiQlm 



Qm-l,lQ 
I 
Pll 



m-1,2 



Qjn-l,lQr, 



Pi, 



I P, 



m-1,1 



P 



m — l,m — 1 



(4) 



where Q = (Q tj ) G * to -1,to,m and P = (P tj ) G $> m -l,M- 
Therefore, the average ( perm(#''~ R )) Rg ^ ^ of the perma- 
nents of over all matrices R G ^ m ,M equals both q m ^M 
and q m -i,m,M' ■ 

Lemma 13. Let m ^ 2 and M ^ 1. Let Q = (Qij) G 
^m-i,m,M and let {[M] \/?i, . . . , [M] \/3 m } be a partition of 
[M] (i.e., m disjoint sets of column indices with union equal 
to [M]). Then 



perm 



i e [m - 1] 

J £ [m] 



11, /?i 



/l2,/3 2 



-1,1)01 Qm-l,2,p 2 

Pll ' ' ■ Pl.m-1 



Ql,m,(: 



Cm— l,m,/5„ 



^5 perm 



'.,3 e [m - 1 



fm-1,1 

Proof: See Appendix A. 



P, 



m— l.m— 1 



(5) 



Corollary 14. Lef g m , M = ( perm{8^ R )) R( _^ m ^, for m ^ 
1, as defined above. Then 



^ M 

qm,M % fn q m -i,M 



(6) 



Proof: The permanent is computed by summing all prod- 
ucts of entries such that each row and each column contribute 
to the product exactly once. The first M rows can contribute 
with Is from the identity matrices on the top block row by 
taking the 1 entries from the columns indexed by [M] \ fix of 
the first block of M columns, [M] \ P2 of the second block 
of M columns, such that [M] \ (3 2 Q [M] \ ([M] \0i)=Pi, 
and finishing with [M] \ j3 m of the mth block of M columns. 
In any such choice of M entries of 1 from the first M rows, 
[M] \ /3i, [M] \ p2,---, [M] \ P m must be a partition of [M]. 
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Let \fti\ =n, then n H h r m = (m - 1)M. Note that the 

columns in the sets [M]\ ftx,[M]\ ft 2 , . . . , [M] \ ft m cannot 
contribute anymore to the rest of the product entries. There are 

(m-W^) = (M-n) = (ri) Wa y S t0 ch00Se the r l column S 

from the first block of M columns, ^ n ^ M. Then there 
are (^) ways to choose the T2 columns from the second block 
of M columns indexed by the remaining r\ — \ft\\ indices, 
^ r?. ^ r\, etc., finishing with (l. m ~ 2 J ways to choose the 
r m _i columns in the (to — l)th block of M columns, $5 
fm-i ^ r m -2- The last M columns are uniquely determined 
by the fact that the corresponding rows in the top block should 
give a partition of [M]. Therefore, we can choose the Is in the 

M ri r m ^ 2 

first M rows in exactly £ (£) E (£) ■ • ■ E CC*) 

ri— r2— r m — 1= 

ways, followed by products with entries in the next M + 
1,M + 2,..., (to - 1)M + 1, (m - 1)M + 2, . . . , mM rows. 
Equivalently, we can compute and upper bound q„ l: M in the 
following way. 



M n 



e o e (5) • ■ • r £ 2 C::;) 

ri=0 T2— r m _i=0 
Qm.M — Qm-l,m,M = r^-rr^ — X 



X 



perm 



(M!)( m_1 ) m 

Qll,0i Ql2,/3 2 ' ' ' Ql,m,P„ 



i e [m] 

M /nr\ r i / \ Vm - 2 

*e : )e : )- E 

ri=0 v 17 r 2 =0 v " 7 r m _j=0 



ft-M* E (^) E 

m q m -i,M- 



r m -2 

' m — 1 

r m - 2 

■ E 

r m _i=0 



;m — l,m,/3„ 



9m — 1, A/ 



r m-2 
Tm—1 



The inequality above holds due to Lemma Q~3] and to the fact 



that 



(A/!)(™- 1 )" 



(M!)( 



Theorem 15. Let H = 



/I 1 1 
1 1 



e E 



m X (m+1) 



\o i i ••• iy 

77ie«, /or a/Z M 1, its degree-M Bethe perm-vectors Ub.m 
and its Bethe perm-vector o>b, based on ft = [to + 1], are 
pseudocodewords for H. 



we know that u>b. 



" '9m-iA/)' anc ^ f rom Cor. [14] we know 

l/M , 1/M 



Proof: From Lemma 

/ x/M 1 '" 

the inequality g, 1 /^ ^ m 1m-\ ai- We obtain that w b,ai is 
a pseudocodeword. Taking the limit and applying Lemma [TT] 
we get that u>b is also a pseudocodeword. ■ 

Note that Theorem Q3] is the same as Theorem [10] stated 
and proved for the particular matrix H displayed above. 

We are now ready to prove Theorem [TOj Since the com- 
ponents of a perm-pseudocodeword based on a set ft of size 
to + 1 are defined as zero outside ft, we can assume, without 
loss of generality, that n = to + 1 and prove the following 
version of Theorem [TOl 



Theorem 16. Let H be any to x (to + 1) binary matrix. 
Then, for all M 1, to degree- M Bethe perm-vectors Ub,m, 
one/ its Bethe perm-vectors u>b, based on ft — [to + 1], are 
pseudocodewords for H. 

Proof: See Appendix B for a sketch of the proof of this 
theorem in the general case. ■ 

IV. Computation of Bethe pseudocodewords for 

TO = 2 AND TO = 3 

A. Case m = 2 

In this case, we can compute the permanent average <?2,m = 
( Perm(0tQ)) Qe ^ M exactly. 

Theorem 17. 52, m = M + 1. 



Proof: We want to compute perm 



for P € V M . 



Since the permanent is computed by summing all products 
of entries such that each row and each column contributes 
to the product exactly once, the first M rows can contribute 
with Is from the two adjacent identity matrices (on top) by 
choosing the 1 entries from the set of columns [M] \ ft\ with 
r = \fti\, ^ r ^ M, from the first block, and ft\ from 
the second block. This implies that the columns indexed by 
[M] \ fti from the first block and ft\ from the second block 
cannot contribute anymore to the rest of the product entries. 
Therefore, we obtain 



perm 



Then 



I I 
I P 



r=0 



=e : e p«»['a p i 



[M]\0i 



92, M — - 



E perm 

P,Q,R,S£V M 



■»pp(fli)i = ■ 

P Q 
R S 



E perm 

P&Vm 



I I 
I P 



(M 



1^4 



M 

E 

r=0 



A I 



E E 

IsuppOj)! = r 



Ml 

perm P^i]^] 



E_(,)r!(M. 

"Mi 



= M+ 1. 



This last equality holds because the permanent of the M x M 
matrix [7^ -P[a/]\/3i] is unless all its columns are different, 
or equivalently, unless the columns of I indexed by ft\ are a 
permutation of the columns of P indexed by ft\, (or, equiva- 
lently, [7^ -P[a/]\^i] is a permutation matrix) in which case 
the permanent is 1 . There are (M — r) ! ways of choosing the 
M — r columns of P and r! ways of choosing the remaining 
columns of P to obtain all possible matrices P 6 Vm that 
give a permanent 1. Given r, there are ( ) = ( M ) ways 
of choosing the M — r columns in [M] \ fti- ■ 

Corollary 18. The possible Bethe pseudocodewords for a 2x3 
matrix H (w/f/; no zero row or column) are equivalent to the 
following vectors ( see Def. |2j. 

'l 1 1 N 



1) //H = 



111 



, then W B ,m aw B = (1, 1, 1). 



5 



2) 7/H = ^ \ ^ , then u b ,m = (l, 1, (M + l) 1 ^) 



and Ub = (1, 1, 1). 

1 1 N 



3) //H 



4) 7/H = 



, then Wb,M 
or H = 



(1,1,1). 
, f/ien 



1 1 0, 
>1 1 1< 
1 y 

WB = (0,1,1). 

Proof: We apply Theorem [T71 to compute the vectors in 
each case. 

1) W B ,M = ((M + l) 1 /M j(M + 1 )l/M j(M + 1) l/Af) K 

(1,1,1). Taking the limit when M — > oo we obtain 

(1,1,1). 



lim u) B .M 

M->oo 



2) u, B) m = = (1- 1» (M + l) 1/M ), where 

/ n iltP\ fr rl 





"1 


1" 


^perm 


1 






perm 



Pe* 2 



I I 
I 



91 



Note that (M + l) 1 ^ 1 2 M + 1 < 2 M , for all 
M ^ 1, proving that u>b,m is a pseudocodeword as the general 
theorem stated. It results in the Bethe perm-pseudocodeword 
(1,1,1). 

Cases 3) and 4) follow similarly. ■ 

Remark 19. For all M > 1, the vector (1, 1, (M + l) 1 /^) 
is always a pseudocodeword for H equal to the all-one 2x3 

(2+(Af+l) 1/M ) 2 

matrix. Its AWGNC-pseudo-weight is equal to 2+(a/+i) 2 / m 
which is an increasing function that has a minimum equal to 
8/3 and this is attained for M = 1, giving the pseudocodeword 
u>b,i = (1,1,2). The Bethe perm-pseudocodeword u>b = 
(1,1,1) has AWGNC-pseudo-weight equal to 3. □ 



B. Case m 

Let t 3 M ■■ 



perm 



1 1 
1 1 1 
1 1 1 



fp 



P£*3,M 

Theorem 20. The following is an exact formula for tz t M- 
£ C) £ (:)(M-r+s)\(M-sy^ J f,'\ M r)(M-ty.(r+ty. 

t3,M — MI3 • 

Proof: Applying Lemmas |5T| and [32] in Appendix O we 

(I I 0\ 

can compute the permanent perm I P / as in on 

\Q R I) 
top of the next page. The permanents 



perm [7 Tl P ai \ 7l Q 



72 



I? 



[M]\ ai \ 72 J 



in © are unless [l 7l Pai\-yi Q72 ^[m]\qi\ 72 ] is an 
M x M permutation matrix. Then, taking the average perma- 
nent over all permutation matrices P,Q,R, yields 

M r M-r 

£(")£(;) £ ( M ^ r )(M-r+ S y.(M- s )\(M-ty.(r+t)\ 

. _ r=0 b = t = 

t3,M - JJT3 , 

where ( Q ) = 1 by definition. ■ 

Remark 21. The above formula for the average can also be 
rewritten as 

M E ( A/-/) (a/4) E ( r)\r ) 
t=0 



£3, a/ — 2^ — 



□ 



We obtain the following corollary. 



Corollary 22. The Bethe pseudocodewords for two non-trivial 
3x4 matrices H (with no zero row or column) given below 
are the following. 

/I 1 1 0\ 
1) IfH = 1 1 1 , then 

v° 1 1 ij 

«b,« - ( M + i) 1/M > ( M + l ) 1/M i ( M + i) 1/M ) • 

/I 1 1 1\ 
2J IfH = 1 1 1 , then 

\o 1 1 V 

"b,m = (g 3 V M , + l) 1/M , (M + l) 1 ^, (M + l) 1 /^) . 
Remark 23. In the first case, observing that: 

M t M — r 

£ (r) £ C)(M-r+s)\(M- S )\ £ ( M - r )(Af-t)!(r+t)! 



r=0 s = 



M! 3 



M r M-r 

E (tO E 0(M-r)!M! E (V) MW 

. r = s=0 t = 



M! 3 



r M — r 



E (^)(M-r)!M!M!r! £ E (* 



s=0 t=0 



M! 3 



M r / \ M — t / , , \ M 

r \ v— v I M — r 



EE I E V 

r=0 s=0 \ / t=0 \ / r=0 

M 

=2 M ^l = 2 M (Af + l), 



we see that indeed the vector ujb,m satisfies all the funda- 
mental cone inequalities associated with the matrix H giving 
that ub,m is a pseudocodeword, as the Theorem [TOl predicts. 
Taking the limit, we get that the Bethe perm-vector u>b is also 
a pseudocodeword. □ 

Example 24. We obtain, as expected, the pseudocodeword 
(4, 2, 2, 2) oc (2, 1, 1, 1) for M = 1 and, e.g., 
(VlO, V3, V3) for M = 2 for the matrix H in Cor. E2 
1). □ 

Remark 25. Note that sometimes we can obtain valid pseu- 
docodewords by taking block-perm-vectors based on a set of 
size m + 1 (without averaging over all possible lifts) as the 
following example shows. □ 

Example 26. Let M = 3, P s , s = 0,1,..., M-l, be the 
s-times cyclically left-shifted M x M identity matrices and a 
matrix H and its lifting H^: 





"1 


1 


1 


f 




'I 


I 


I 


I 


H = 





1 


1 


1 


, H^ = 





I 


p 


P 2 







1 


1 


1 







I 


P 2 


p 



6 



I I 0> 

perm I I P I I = perm(7 + P + Q + R) 



K Q R I j 



M 



perm[(/ + P) ai (Q + R)[M]\ ai ] 

r=0 ai c [M] 

supp( ai )| = r 

A/ r M—r 

Yl X] perm [ J ^ P «A7i Q72 ^[Af]\ai\7a] ( 7 ) 

r=0 01 c [Af] s=0 nCoj t=0 t 2 £[m]\qi 

I supp(ai)| = r I supp(-7i)| = s I supp(^ 2 )l = * 



Let w« be computed as following 



wm = perm 



perm 



l/M 



1/M 
/ 



I 
I 
I 

P 2 
P 



I 

P 
p2 



I 

P 2 
P 



, perm 



l/M 



P 

P 2 



p2 
P 



, perm 



l/M 



P 

p2 



= (48^ M , 2 1 / M ,2 1 / M ,2 1 / M ) = ^2(2^3, 1, 1, 1). 

This is a pseudocodeword equivalent to the pseudocodeword 
(2^3, 1, 1, 1) with AWGNC-pseudo-weight 3.58. 

Note that this is not always the case, an example can be 
easily found. In general, averages over all liftings need to be 
taken in order to obtain pseudocodewords. □ 

V. Conclusions 

In this paper we proved a stronger version of Vontobel's 
conjecture [7] on Bethe pseudocodewords and computed the 
families of pseudocodewords obtained by using the Bethe per- 
manent and the degree-A/ Bethe permanent in some particular 
cases. We also highlighted some interesting properties of Bethe 
permanents and their relationships to pseudocodewords. 
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Appendix 

A. Proof of Lemma \TJ\ 

Let 4 {pi,..., M, and let 



rri A 

1 = 



Qm-l,\,Pi Qm-l,2,ft ' ' ' Qm-l,m,P„ 

like in the statement of Lemma [13] Note that Tg is of 
size (m — 1)M x (to — 1)M. Each of the columns of 
[QuA <9i2,/3 2 • • • Qim,p m ] has Hamming weight 1 and 
each of its rows has Hamming weight at most to. Let 
no, ni, . . . , n m be the number of rows of weight 0, 1, . . . , to, 
respectively. The total number of rows is then uq + n\ + n-2 + 
■ ■ ■ + n m — M and the total number of entries equal to 1 in 



the matrix is m + 2«2 H Y Tnn m = (m — 1) AI. We obtain: 

(to— l)-(n + ni + n 2 + - ■ - + n m ) = ni+2n 2 + - • - + mn m <^> 
(to — l)no + (m — 2)ni + (to — 3)n 2 + • • • + n m -% = n m . 
If n m > we obtain that with each row of weight to there 
is at least one row of weight m — 2 or lower. If n m = 
we obtain that no = n\ = ■ ■ ■ = n m -2 = and hence all 
rows and columns have constant Hamming weight to — 1. We 
will show that the first case can be reduced to the second 
case by a modification of the matrix that leaves the permanent 
unchanged or increases it. 

We have two cases that we prove independently, the case 
of n m > and the case of n m = 0. The proof of the first 
case is followed by Example [27] and the proof of the second 
case contains Example [28] and is followed by Example [29] in 
order to better illustrate the mathematical techniques used in 
this proof. 



Case 



> 0. 



Proof: We can assume that no = 0, otherwise the 
permanent is and does not contribute to the sum value 
of all permanents. There are to permutation matrices in the 
matrix [Q 11 Q12 ■■■ Qi m ] from which columns indexed 
by /?i,/32,.-., and (3 m , respectively, are chosen to give the 
M x M(m - 1) matrix [Qu,Pi Qi2,p 2 ••• Qim,p m ]- 
Therefore, the inequality n m > means that there exists a 
column [0 • • • 1 ■ ■ • 0] that gets picked from 
each of the matrices Qn, Q12, ■ • • , Qim- This gives > 0, 
for all i € [to]. We can permute the first M rows of Tjg 
(process that does not alter its permanent) and assume that 
this column is [l • • • 0] . We also obtain that there is 
another column which gets picked from at most to — 2 of the 
matrices Qn, Q12, ■ ■ ■ , Qim- We permute the first M rows of 
Tfi by leaving the first row fixed, and assume that this column 
is [0 1 • • • 0] . We can also assume that this column 
does not appear in Qn,^ and Qi2,p 2 - Therefore, without loss 
of generality, we can assume that Tp is of the form displayed 
in ©, where, (up to column permutations within each block 
of M columns) 



7 



Ta = 



A 



(i) 



1 







1 

1 



A { r } 



(8) 



i 




A™ 





1 



A^ 



A® 



1 

1 



A { ™ ] 



(9) 



perm(r,g) — perm(T^) 




perm 







A 



(i) 



perm 



Af 

P2 



,(2) 



A 



(3) 

&3 



,0) 

l 03 





1 



Am) 
A P m 

1 




Am) 



(10) 



perm(T^) - perm(T^) 






= pcrm 



perm 



perm 



perm 



4(1) 


1 



A 



(i) 

/3i 



1 



A 



(i) 


1 





A™ 



Af 

P2 



Af 

P2 



A 



(2) 



A 



(2) 



Af 

P3 



,(3) 



,(3) 



4 3) 

P3 





1 



A fi m 



1 





Am) 

A li m 


1 







A 



(m) 

/3 m 





1 



A { r ] 



(11) 



(12) 



s 



and 



.4 



(i) 



.4 



(2) 



181 182 
<321,/3i 



.4 



(m) 



/3m 



Q2m,/3„ 



Let To be the matrix displayed in ([9). The two matrices TJg 
and T"g differ in two positions only, in the first two rows and 
the second block of M columns. An entry equal to 1 in the 
first row gets "moved" to the position below in the second row 
and the same column. Therefore, the permanents of Tp and 
Ti differ only in the elementary products (products containing 
exactly one entry from each row and each column) that contain 
the "moving 1 entry"; their difference is given in (fTOb . The first 
matrix in ( fTOb has its first row of weight 1 (changed from the 
first row of Tp of weight m) and its second row of weight up 
to m — 2 (equal to the second row of Tp). The second matrix 
in ( [Tol l has its first row of weight m — 1 (changed from the 
first row of TL of weight to) and the second row of weight 
1 (changed from the second row of TL of weight less than or 
equal to to — 1). Permuting the first two rows of the second 
matrix in (TTOb gives formula (TTTb and changing a zero entry 
into a 1 entry on the second row of the first matrix give a 
larger difference of permanents expressed in ( fl~2l . 

The last two matrices in ( fl~2l differ now only in the second 
row, namely, in the positions of the 1 entries on the second row 
in the last m— 2 blocks. They have both the first row of weight 
1, the second row of weight m — 1, and all the other rows 
equal to the corresponding rows of Tp. We now observe that 
allowing the matrices Qij with i £ [m — 1] , j £ [to] , i ^ 2, to 
vary among all possible permutation matrices, while keeping 
the first M rows fixed, gives us two equal sets of matrices. 
This can be seen by interchanging two columns in each Qij 
of a matrix in the first set to obtain a permutation matrix Q\j, 
for all i £ [to — £ [to], i ^ 2 and j ^ 3. Setting also 



Qa — Qij-> i G 



£ [to], i ^ 2 and j £ {1,2}, then 



these choices of Q'^ with i ^ 2 and j ^ 1 give a matrix in the 
second set, and vice-versa. The two sets being equal means 
that the sum of all differences of their permanents over all 
matrices Qij with i £ [m — 1], j £ [m], i 2, is 0. Since 

^ perm(T^) - perm(T^) < 

i e [m- 1] \ {1} 
i e [m] 

we obtain 

XI P erm ( T /3) = H X perm(7» 

« e [m - i] j e [m] < e [*» - 1] \ {1} 

j E [m] 

< X Yl perm(T^) = ^ perm(T^) 



Qij e % Qij e p a/ 
j e [m] ie[m-i]\{i} 



Therefore, by "moving" a 1 entry from a row of weight m 
(among the first M rows) to a row of weight at most to — 2 
(see dHJ and (O) gives a new matrix T'p of the same form as the 
original matrix, but with its first M rows with only n m — 1 
rows of weight to. Summing over all possible permutation 
matrices, this change gives a larger value of the permanent 
sum, therefore we can work with this new matrix. 

We proceed similarly with each block of M rows that 
contains a row of weight to, to obtain a matrix with each 
row of weight m — 1. Thus, we substitute each matrix in the 
first sum in having n m > with a matrix that has each 
row of weight m — 1. ■ 



Example 27. Let M = 3, m = 3, 



Q = 



1 

1 

1 

1 

1 

1 



1 

1 

1 

1 
1 
1 



1 

1 

1 

1 

1 

1 



and fa 4 {1, 2}, /3 2 ^ {1, 2}, ft = {1, 2}. Then 



Tp = 



1 

1 



1 



1 



1 

1 



1 

1 





1 

1 



1 
1 




The second and the third rows of the first block of 3 rows of 
Tp have weight 3 = to and weight 1 = to — 2, respectively. 
Similarly, the first and the second rows of the second block 
of 3 rows of Tp have weight 3 = to and weight 1 = to — 
2, respectively. We can modify the matrix in two steps, by 
constructing 



1 

1 

1 



1 



followed by constructing 

1 

1 



1 

1 




1 

1 



1 - 





1 

1 







1 

1 





1 

1 



1 
1 






1 

1 



1 
1 




and showing that the change from Tp into and then into 
Tp only increases the average permanent over all permutation 
matrices Q £ ^2,3,3 ■ TL has the first block of M = 3 rows 
of weight 2 = m — 1, while Tp has constant row weight 

2 = to - 1. □ 
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0" 




























1 








1 












Ql2.0 













1 








1 













2 


Q 


13 81 
























Q22.fi 




Q 


23,0 3 _ 










1 





1 





) 




















(J 


1 





(J 





1 






















1 


n 
u 


n 
u 


1 
1 


n 
u 


n 
u 








"o" 






1 








"0" 






"0" 















) 


"13 — 







^22 - 




1 




^23 = 















1 






u 















1 




















_ 




1 


0" 




















1 


_Q 12,02 


1 
S\2\ -- 




1 










P12 


- [Ql3,03 


S13J 







1 



















1 














1 
















"1 





0" 














"1 





0" 


Q%2,02 


S22] = 










1 


1 P22 


— [Q23,0 3 


^23] 







1 
















1 























1 



(13) 



(14) 



(15) 



Case n r< 



0. 



Proof: In this case, we can split each of the matrices 



Qn,p x , i G [m— 1], into to— 1 sets Sij of columns such that the 
matrices [Qij,p s 
of size M, for all 1 



-i are all permutation matrices 
€ [m — 1], and j € [m],j ^ 2. In other 
words, each matrix Qij,p with j > ^ 2 needs Af — | columns 
to get completed to a permutation matrix Pjj_i, and these 
columns may all be found in the matrix Qnjj 17 i £ [m — 1]. 
Note that no one column is needed for completion by two 
different matrices Qij p , Qik,/3 k , j 7^ K because if so, then 
there would exist a row with a lower weight than m — 1, thus 
contradicting the assumption we are under in this case. 

Therefore, we can apply a permutation on the first columns 
in (3i of Tp to arrange them so that the first A/ — |/? 2 | columns 
of these form the set S12 that completes the matrix Qi2,p 2 
to a permutation matrix Pn, the next M — \^\ columns of 
these form the set 1S13 that completes the matrix Qi3.^ 3 to 
a permutation matrix P12, and so on. Since the permanent 
is not changed when permutations of columns or rows are 
applied, we can assume, without loss of generality, that Tp 
has this "order" on the first fti columns. We denote by a the 
permutation of columns of Tp required to change its first M 
rows as following (by extension, for simplicity, a will also 
denote the induced permutation of columns on any submatrix 
of Tp obtained by erasing some of its rows): 



<r[Q 



n,0i 



Q 



Let 



°{Tp) 



l,m-l,0„ 



Pll 
R21 



[P-- 



11 



Pl,r 



P\,m- 
R2,m- 



1? 



m— 1,1 



R 



m — l,m — l 



where each Rij — \_Qij.p j S\j\, j ^ 2, is a matrix of size 
M x M. If are all permutation matrices, or equivalently, 



if Sij = Sij, then 



P11 
P21 



Pm—l, 



Pl,m- 
P2,m- 



P 



m — 1 , m — 1 



(16) 



each Pij is a permutation matrix of size M x M, and Tp has 
the same permanent as the latter matrix. 

Example 28. Let Tp with constant row weight m — 1 = 2 as 
in ( fT3] > and let 512,513,522,523, as in (TBI . (Note that Tp is 
the matrix T^ in Example [27]) Let 

Pll — [Ql2,p 2 5 i2 ] , Pi 2 = [Ql3,0 3 5i 3 ] , 
P2I = \Q22fi2 522] , P22 — [Q23,fe ^23] ) 

as described in ( fT~5T > 

Let a denote the permutation operator that permutes the 
columns of Tp such that the first column gets moved to 
the 6th position and the second column gets moved to the 
3rd position, thus completing the matrices Qi2,p 2 an d Qi3,/3 3 
to the permutation matrices P\\ and P12, respectively. We 
compute cr{Tp) and obtain 



1 

1 

1 

1 
1 
1 



1 

1 

1 

1 

1 

1 



Pll P12 
P21 P22 



since the a column permutation completes also the matrices 
Q22,p 2 an d Q23,p 3 to the permutation matrices P21 and P22, 
respectively. This achieves the desired form. □ 

We will now address the case where the order does not 
get preserved in the next M rows. For simplicity, we suppose 
that S2j 7^ Sij. Therefore, we need an extra permutation of 



10 



^2 perm(7» - perm(T^,) 



3 6 [m] 



E 



perm 



3 6 [m] 



Q21,/3i ^2 



perm 



Qij. Q23 e % 

3 £ [m] 



Qll,/3i 

1 
1 





An-1 



E 



perm 



Qij. Q23 e P M 
i e [H 



-4i 



-4 2 



Qm-l,l,/3i 



perm 



3 e [m] 



?m-l,l,/3i 4 m _i_ 

Qua -4i 

1 

1 





(17) 



Q13.Q23 6 Pjw 

3 € [m] 



perm 



-4i 



A2\rowl 



E perr 



Q13, Q23 e t m 
3 e [mj 



?TO-l,l,ft\{l} An-1 
Qll,/3i\{l} A 



A\row2 



Qm-l,l,/3i\{l} An-1 



perm 



Qij. Q23 e 

3 6 [m] 



Qll,/3i\{2} A 



A\row2 



E 



perm 



Qij. Q23 e t>m 

i € [m] 



.Qm-l,l,/3i\{2} 4 m _i 
Qll,/3i\{2} A 



A\rowl 



= (18) 



Qm-l,l,ft\{2} 4 m _i 



columns within the block matrix Q2i,^i so that we obtain 
the equality iS>2j = Sij- In addition, we need to show that 
this change does not alter the sum of the permanents of all 
c(Tg) over all possible permutation matrices Qij. In fact, it 
is sufficient to show that the operation of interchanging two 
columns within the matrix Q2i.p x does not change the sum 
of perrr^Xjg) when computed over all possible permutation 
matrices Qij. This fact, applied sequentially to each matrix 
Qu,Pi, i ^ 2, until the desired form is obtained, will conclude 
our proof. 

Without loss of generality, for simplicity, we can assume 
that the two columns of Q21 p x that get interchanged are the 
vectors [l ••• 0] T and [0 1 ••• 0] T . Let 
us denote by Q 2 i ft me ma trix obtained from Q2i,p x , and 
Tp be the matrix obtained from Tp, after the two columns 
get interchanged. In equation dT7l > we compute the difference 
of the permanents of the two matrices and sum this differ- 



ence over all permutation matrices Qij and Qij- We denote 
At = [Qi2,p 2 ■ ■ ■ Qi,m-i,p m ], for all i G [m - 1]. After 
performing consecutive cofactor expansions on the first and 
second row of the second block of M rows of Tp, we obtain 
that this difference is given by d 1 8t > . where A \ rowl denotes 
the submatrix of A2 obtained by erasing its first row and 
A2 \ row2 denotes the submatrix of A2 obtained by erasing 
its second row. We note that the first and the last sums of the 
four sums in dT8b are equal, and so are the second and the 
third sums, and so the four sums cancel each other and give 

Perm(7» - perm(^) = 0. 

Qij,Q2jeV M 

Summing over all matrices Qij e Vm> we obtain 

^2 perm(T ( g) - perm(T^) = 

Qij 6 fM 
i,i e [m] 
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E perm(2» - perm(T^) = 0. 



Qij 6 T M Qlj,Q 2 j e T>M 
6 \M\ \ {1, 2} 3 6 [M] 



Therefore we can change the position of the columns within 
each matrix Qn^ 1 , for all i ^ 2, until we obtain a matrix 
of the form given in ( fT6l ), without changing the sum of the 
permanents of Tp computed over all permutation matrices Qij. 
This, together with the previous case, concludes the proof. ■ 



Example 29. Let 



l 



1 



1 
1 



m,/3 2 

?22,/3 2 

1 

1 



1 

1 



/13./3; 

0' 



1 
1 




with constant row weight m — 1 = 2. Let 





"0" 




"1" 




"0" 




"0" 


$12 — 





; $13 — 





, £>22 — 


1 


1 <$23 — 







1 














1 



and 



Pll — [Ql2,0 2 S12] 



P12 = [Q 



13, & 



«Sl3 = 



P2I — [Q22,p 2 S22] = 



P22 = [Q 



23,ft, 



<?23 — 



1 

1 
1 

1' 

1 

1 

1 0' 

1 

1 

1 0' 
1 
1 



Let a denote the permutation operator that permutes the 
columns of Tp such that the first column gets moved to 
the 6th position and the second column gets moved to the 
3rd position, thus completing the matrices Qi2,,32 an d Qi3,/3 3 
to the permutation matrices Pu and P12, respectively. We 
compute <j{Tp) and obtain 



P11 P12 
R21 R22 



1 

1 

1 

1 

1 1 



1 

1 

1 



1 
1 1 




The 



(7 column permutation does not complete the matrices 
Q22.P2 an d Q23,p 3 t° the permutation matrices P21 and P22, 
respectively. 



Let 



rpl _A 

± I3 - 



1 

1 

1 

1 
1 
1 



1 

1 

1 



1 
1 
1 



-Pll -P12 
P21 P22 



obtained by interchanging the 3rd and 6th columns of u{Tp). 
The above computations show that this change does not alter 
the average permutation over all permutation matrices Q e 



^2,3,3- T'g has now the desired form. 



□ 



B. Sketch of Proof of Theore mlm 

Proof: We can modify Lemma [13] and its proof to 
include other types of matrices. For example, for a matrix 
9 of size m x m with r entries of 1 and m — r entries of 
zero on a row, we would modify the lemma to show that 
perm B M (9) ^ r perm B M (6), where 9 is an (m— 1) x (m— 1) 
submatrix of 6 obtained by erasing the row of weight r and a 
column that gives the lowest nonzero permanent among these 
matrices (m — 1) X (m — 1) matrices. The proof follows all 
the steps above. The case when H has a column with weight 
1 is basically the hardest one. In the other cases, we can use 
that perm B M (l (m _ 1 ) x(m _ 1 )) ^ perm B M (6') if 9 contains a 



submatrix 1 



(m— 1) x (m— 1) 



to obtain that the fundamental cone 



inequalities are satisfied for the row containing the only 1 of 
that column. The other inequalities are trivially satisfied (all 
vector components are equal) or can be reduced to the case 
of (m — 1) X m matrices. ■ 

C. Necessary Lemmas 

This Appendix contains a few results that we need in our 
computations. Versions of the first two lemmas can also be 
found in ifTTl . 



Lemma 30. Let c; € F, 



(M-l)xl 



A&F, 



(Af-l)x(M-2) 



and the 



all-zero matrix of size 1 x (M — 2). Then, the following 
"expansion " of the permanent holds: 



perm 



1 

Cl 



1 

C2 



perm [ci + c 2 A\ 



Proof: Applying the cofactor expansion on the first row, 
the above permanent can be rewritten, based on the row-linear 
property of both determinant and permanent, as 

perm [02 A\ + perm [ci A\ = perm [ci + C2 A\ . ■ 

Lemma 31. Let A, B be two square matrices of the same size 
M. Then 



perm(yl + S)= V perm [A a B [M] \ a ] . (19) 



E 

aC[M] 



Proof: The permanent of the matrix is a sum of all pos- 
sible non-zero elementary products. Each elementary product 
contains a 1 entry from each row and each column and this 
entry can be taken either from the matrix A or B, giving the 
above sum. ■ 
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Using these two lemmas the following result can be derived. 



Lemma 32. Let P,Q,R,S be permutation matrices, and I 
the identity matrix, all of size M. Then 



perm 



I 


i 





I 


p 


I 


Q 


R 


I 



= perm(7 + P + Q + R). 



(20) 



Proof: We apply Lemma [30] sequentially for the first M 
rows and then the last M columns, and we get 



perm 



I 


i 


0" 




I 


p 


I 


= perm 


Q 


R 


I 





p 

-R 



:perm(7 + P + Q + R). 
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